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ABSTRACT 

This compilation presents material relating to the 
Content Reading in Secondary Schools (CRISS) program, developed by 
Kalispell, Montana schools. The program focuses on science, math, 
English, and social studies and is designed to help all students 
read, write, and learn more effectively. The compilation contains 
general information about the CRISS program, an "adopter's guide" (a 
manual for school administrators), and then presents the adoption 
agreement, agendas for a 2-day and a 3-day reading and writing across 
the curriculum inservice program, samples from the training manual 
and student examples, evidence of the effectiveness of the program, 
and a reprint of an article about a CRISS program implemented in 
Maine. (RS) 
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GENERAL INFORMATION 
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^ Content fading in Secondary Schools 



The Content Reading in Secondary Schools (CRISS) Project fills a 
striking need in our educational system. It is the goal of the 
CRISS Project to provide students with skills that will help them 
better organize, understand, and retain course information. In 
short, students receiving the CH1SS method of instruction will 
learn how to learn." 

The CRISS program was developed in the Kalispell, Montana 
Public Schools beginning in 1979. The program was written by 
teachers under the direction of Dr. Carol Santa, District 
Reading Coordinator. Since its origin the program has been 
highly successful as evidenced by its being selected first, as a 
state validated demonstration site, and then as a nationally 
validated project, for grades 10 through .12, in March, 1985. 

THMROJ_CA_L__BASE : In order to enhance student learning, CRISS 
employs three concepts, drawn from cognitive psychology First 
students must be able to integrate new information 'with prior- 
knowledge. Second, students must become actively involved in 
their own learning. Third, students must be able to monitor 
their own learning in order to identify which strategies are 
the most effective for a given set of learning materials. The 
project holds that. these skills can and should be taught by 
secondary content teachers and that they are key to maximizing 
the aquisition of information. 

FRAMEWORK. FOR .... EFJEC^TJVEjrE ACHING : To present CRISS strategies 
in the classroom, the teacher must use an instructional stvle 
that is direct and includes four sequential components: 

1. Introduction 

2. Modeling 

3. Guided Practice 

4. Independent Application 

The following example may assist in understanding how 'he*<. 
components are used in the classroom setting. [ n teaching 

students how to understand main ideas through text organization" 
the instructor may use the following steps: 

l « Introduction. The instructor first develops rules or 
steps for analyzing the organization of a text. The 
teacher. and students discuss the various ways in which 
mam ideas can be presented and identify specific 
reading procedures for discerning the author's style. 
For example, a text may be written with main ideas noted 
in the introductory paragraph, in topical headings, or 
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within the opening sentences of each paragraph. Helping 
students understand the organ iz at ional style is a 
prerequi si te to comprehension • 



2. Modeling. Direct instruction continues by teacher 
modeling. The teacher "talks through" or verb Ml ly 
models for the students his/her own reading of a 
section of the students' text, By doing this, students 
hear and observe how their teacher employs text organi- 
zation skills in order to comprehend meaning. With 
such modeling the students learn the why, when, where, 
and how of each new strategy. 

3. P.Mided Practice . Next, students attempt to use the 
modeled strategies on their own. Class time is allowed 
for discussing how text organization helped (or hin- 
dered) student comprehension. The importance of 
re-reading in cases where text organization is not 
immediately obvious is stressed. Throughout, students 
discuss concepts presented in the text and identify 
sample examination questions which demand critical and 
evaluative thinking. 

4- Independe nt A pp 1 icat i on . After sufficient guided 

practice, the students independently apply what, they 
have learned about text structure. 

The sequence of direct instruction, teacher modeling, guided 
practice, and independent application is followed in all aspects 
of the CRISS program. 

INSTRUCTI ONAL S TRATEGIES : The instructional content of the 

CRISS Project includes the following: 

1* Text Assessment . In this component, content teachers 
learn how to analyze their texts. This includes an 
evaluation covering the areas of organization and 
vocabulary. 

- • ? t u dent Ass essment . Participants learn met. hods for 
developing tests which will evaluate how effectively 
students are reading and learning from their textbooks. 
Successful models and a student assessment checklist 
are provided in this section. 

3 • Teaching Te xt Or gani zat ion , Once teachers know and 
understand the organization of their text, thev must 
teach their students how the text is organized. The 
CRISS manua I presents several strategies and teacher - 
made forms which will aid in this present a t ion . 

1 . Mai n_l_dea B^LV. c?i.PI>m^i?.t • Participants learn bow the 

organization of their t .it influences the? content an<! 
how to help students familiarize themselves with the 



author's stylo of main idea development. They also 
learn active procedures ( summarizing, underlining, and 
notetaking) for extracting main ideas from the text, 
and strategies for teaching students to self -moni tor 
their progress in understanding these ideas. 

5 • Learning . Guides _ and Writ i ng m Act i v i t ies . Teachers a re 
presented numerous learning guide formats. These are 
designed to help students actively organize written or 
verbal information for understanding and retention. 
They also provide a framework for studying and moni- 
toring comprehension. The writing activities are used 
to reinforce and enhance learning. Writing guides and 
formats help students organ ize and present material in 
a clear and concise manner . Teachers are presented 
with a variety of ways to assign written activities. 

6 • y-£cabulary_. Part ici pants learn procedures for helping 

students develop vocabulary skills. Specific strategies 
such as the use of context, structural analysis, and 
cat ego r izat ion are represented . 

7 - Air.§.cJ:_ed.,Readi_n The Directed Reading 

Activity (DRA) incorporates everything presented in the 
program into an overall approach to teaching reading 
in the content areas. The DRa framework helps teachers 
develop a set of activities for students to use before, 
during, and after reading to generate comprehension and 
retent ion . 

MATERIALS: 

All instructional materials are provided by the project. 
These materials supplement, but do not replace the content 
text. The training manuaJ contains specific classroom- 
tested examples i :i the areas of science, English, mathe- 
matics, and social st.udiies for each topic covered. These 
topics, as described earlier, are: Text assessment, 

Student Assessment , Teaching Text Organization , Mai n Idea 
Development, Learning Strategies, Vocabulary, and Directed 
Reading Activity. In addition, an Adopter's Guide, for 
school administrators, outlines CRIS& implementation and 
evaluation procedures and includes a plan for incorporating 
the project throughout a district's curriculum. No mater* 
ia.ls, other than regular course texts, are required of 
workshop part ici pan ts . 

S TAK F_ D KVK LOPMKNT : 

CR1SS participants (we suggest two from each content area 
and one administrator from each school) are required to 
attend a two or three clay inservire. This inservice wilj 
include an introduction to the theoretical framework ot the 
project along with instruction and work sessions for each 



of the seven components, In this way, teachers leave the 
workshop with the procedures and materials for immediate* 
program implementation. 

A local facilitator will be looted from each district or 
school to oversee the project and he a liaison between 
teachers and the CHI3S Project staff. The facilitator will 
also be in charge of staff and student evaluation and 
assessing the follow up needs of the district. 

EVALUATION : 

For a school district to know that a project is successful, 
it is necessary to evaluate continually both the partici- 
pating teachers and their students. The project will 
provide developed evaluation materials. These include an 
implementation checklist for teachers and pre and post 
tests for students. The statistical results of the stu- 
dents' tests will be provided at no cost to the district. 

CO ST. OF ADO PT 10 N : 

The project charges a $40.00 per participant fee { f or more 
than 15 participants the fee is negotiable). This covers 
the cost, of tbs 200 page training manual, the Adopter's 
Guide, workshop materials, and evaluation. The costs of 
travel, lodging, and trainer expenses will be negotiated 
between the adopting district(s), the State Facilitator, 
and the CR1SS Project staff. 

CR 1S_S_ _ PRO J EC T ._ S TAFF : 

Currently the CRISS staff consists of Dr. Carol Santa, 
Project Director, and Ms. Lynn Havens, Project Trainer. 
Several content teachers in Kalispell's School District No. 
5 are also available as. certified trainers for CHISS. If 
we can give you further assistance, please write or call: 

Dr. Carol Santa / Ms. Lynn Havens 
CRISS Project 
233 First Avenue East 
Kali spell , Montana 59901 

(406)755-5015 
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ADOPTER'S GUIDE: A Manual for School Administrators 



The Content Reading In 
designed to help all s 
effectively. Our proj 
reading is everyone's 
can be done very effec 
f irmly committed to th 
from basic to advanced 
learn course ir;.formati 
and the content areas, 
social studies, provid 



Secondary Schools Project (CRISS) is 
tudents read, write, and learn more 
ect is based on the premise that teaching 
responsibility and that such teaching 
tively within the content areas. We are 
e notion that all secondary students 

students must be taught how to read and 
on. These are skills which must be taught, 

such as, science, math, English, and 
e an excellent medium for such instruction. 



Our project, developed entirely by secondary content teachers, 
focuses on four areas: science, math, English, and social 
studies, however, it may be successfully used in any course 
using written materials. Teachers in each of these content 
areas have developed instructional strategies and materials which 
they have evaluated in their classrooms. Sample materials from 
each of these areas are included in the training manual. 

Because the project demonstrated persuasive evidence of effec- 
tiveness, we were validated in May, 1981, as a state domonstration 
site, and in March, 1985, we were approved by the Joint Dis- 
semination and Review Panel (JDRP) and funded by the National 
Diffusion Network (NDN) . Although the project was only validated 
for grades 10-12, it has been successfully used in grades 4-12. 
Project students compared to control students demonstrated 
superior performance in their coursework after applying content 
reading strategies. Significant outcomes were observed in all 
content areas. In addition the project appears to have a positive 
effect upon students' and teachers' attitudes toward reading within 
the content areas. 



The CRISS project has been developed to fit into the existing 
curriculum. It is not necessary to change either the content 
or the materials used in any teaching situation, rather the 
project advocates a change in teaching style. 
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TRAINING 



The CRISS staff provides either a two or three day inservice 
training at the adoption site. We recommend that at least one 
or two teachers from each content area attend and that one 
administrator be present. The topics covered during the two 
and three day training workshops are approximately the same. 
The advantage of the three day workshop is that the teachers 
will have more time to develop materials which can be directly 
implemented into their classrooms. 

It is important for teachers to bring copies of the texts they 

are currently using so they may use worktime to develop appropriate 

curriculum materials. 

TRAINING MANUAL 

Those teachers who participate in the training will be provided 
with the CRISS Training Manual. The manual is divided into 
chapters which cover the main components of the project: 

1. Theoretical background - This section discusses the 
teaching styles and strategies that are implemented throughout 
the manual . 

2. Textbook analysis - In this chapter are checklists with 
which to evaluate existing or new texts as to their organization 
and how easily they may be read and understood by students. 

3. Student Evaluation - This chapter shows several methods 
for evaluating the reading abilities and study skills of students. 

4. Teaching text organization - Before students can 
learn effectively from a text they need to know how it is 
organized, this section shows several strategies for presenting 
text organization. 

5. Main ideas - This chapter is designed to give the 
teacher lots of ways of helping students discover the main 
ideas of a reading selection. Example activities are explained 
and illustrated. 

6. Learning and writing strategies - Once students are 
able to pull out the main ideas of a selection the_ need to 
organize and use them. This chapter shows many forms of note- 
taking (learning guides) and provides teachers with imaginative 
writing ideas which can easily be applied to all content areas. 
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7. Vocabulary - The vocabulary chapter is divided into three 
sections: contextual clues, categorization & structured overviews, 
and structural analysis. Each provides activities the teacher 

may use in teaching vocabulary in the content areas. 

8. Dir ected Reading Activity (DRA) - This final chapter 
helps the teacher develop a lesson plan for a given unit which 
incorporates the theory, strategies and activities presented 
throughout the manual. 



LOCAL FACILITATOR 

It is our hope that the CRISS project will eventually be used 
throughout the district by all teachers, not just those trained 
by our project staff. As part of the adoption requirements, 
you are to appoint one teacher or administrator, who has 
attended the training, as a Local Facilitator. The facilitator 
should be someone who is respected and has credibility with 
the teachers. It will be the job of this facilitator to meet 
individually with the teachers who have been through the in- 
service training on a regular basis. We also suggest short 
group meetings after school every other week. These meetings 
should be sharing sessions. We have found distributing a 
monthly or bi-monthly newsletter of ideas to be very helpful. 

At a time decided on by the faciliator and teachers , there should 
be a half-day (release time) sharing session. Again, a news- 
letter of project activities should emerge from this session. 

The i,ocal Facilitator needs to begin identifying teachers who 
have become particularly skilled in project implementation. 
These teachers should be encouraged to beccme on-site facilitators 
trainers responsible for doing staff training with other teachers 
in the district not originally part of the adoption. 

About two months after adoption, the Local Facilitator will have 
each participating teacher complete an implementation checklist 
which covers the same areas as the "Teacher Adoption Agreement" 
sxgned by the teachers at the end of the adoption workshop 
The implementation checklists are provided by the project One 
copy will be used by the project staff for the follow-up sessions. 

The Local Facilitator should also be a liason between *-he trained 
teachers and the project staff. We should be notified at once 
if there are any questions or problems. Together the facilitator 
and staff will determine the scope and method of follow-up. 

You will find a checklist for the Local Facilitator on pages 5 and 6 
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COST TO ADOPTING DISTRICT 



1. Release time for teachers participating in the two or three 
day inservice training. 

2. 4 0.00 per participant fee, which covers the cost of the 
training manual, this adopter's guide, workshop materials, 
evaluation and follow-up. 

3. Travel, meals, and lodging expenses for the project trainer. 
These are negotiable and may be shared with the state facilitator 
for National Diffusion Network (NDN) projects. 

4. Time for teachers to share knowledge and to adopt curriculum 
materials. Adopting district can choose to use PIR time, release 
time, or after school sharing sessions . 
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IMPLEMENTATION CHECKLIST FOR LOCAL FACILITATOR 



1 . 



3 . 



4 . 



5. 



diSSfn? 'I esta blished in the 

? ,£° r ado P fci ng the CRISS 
project (test scores, teacher 
concerns) 

^f?2 1PaC £ litator has ^en iden- 

diJec?oi n ^ S district (curriculum 
director, principal) who is respon- 
sible for directing the project 

The adoption of the CRISS project 
was discussed with department 
chairmen and key teaching staff 
and their support was demonstrated. 

anS°^ b ° ard members were informed 
of c£Is SUpP ° rtlVe of adoption 

Teachers were oriented and allowed 
to volunteer for the CRISS inter- 



date 



date 



date 



date 



date 



7. 



8. 



Teachers and key administrators 
?r"™ g ,H lth - the L ° Cal facilitator 

Se CR h Is in triCt P artic iP*ted in 
v-ue LKibS mservice. 

S e vJS; 1 e .f; Cilitat0r haS "ranged 
to visit classrooms of project 

baSs'to SV* 1SaSt a Wi^SSy 
basis to help with implementation. 

The Local Facilitator has. arranged 
sharing sessions so that project 

shar^ 3 haVS . an °PP°rtunity D to 
share ideas with one another. 

tnl t°aci/ aCilitat ° r has hel Ped 
tne tvachers monitor the imple- 
mentation of CRISS in their cLss- 

5hecV! TeaChSr Im Plement^ion 3 
Cnecklists, student reactions) 



date 



date 



date 



date 
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10. The Local Facilitator has encou- date 
raged the project teachers to keep 

a record of student performance 
so that they can evaluate the 
effectiveness of the CRISS project. 

11. After six to eight months, the date 
Local Facilitator and teachers, 

using the Teacher Implementation 
Checklist, will reaffirm their 
committment to the project. 

12. After six to eight months of imple- date 
lncntation, the Local Facilitator and 

th'j teachers will plan CRISS inservice 
for other teachers in the district. 

13. The Local Facilitator and the date 
teachers refine the curriculum 

units at least annually. 

14. The project teachers with the date 
help of the Local Facilitator 

will conduct a CRISS inservice 
for the other teachers in the 
district. 

15. The Local Facilitator will con- date 
tinue to monitor how teachers 

have implemented the CRISS pro- 
ject within their respective 
classes. 

16. The Local Facilitator will con- date 
tinue to arrange time for teachers 

to share ideas with regard to 
the CRISS project. 
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CONTENT READING IN SECONDARY SCHOOLS 
ADOPTION AGREEMENT 



District Name 
Contact person 
Address 

Phone 



Date 



( 



) 



Proposed training dates 
Local Facilitator 
State Facilitator 



Phone 
Phone 



Classification of adopting district: 

Urban (large city) 

Other urban 

Suburban 

Rural 

Public 

Private 



Congressional District 
Number of high schools 
Grade levels to be served 



Estimated number of students to be served at each grade level: 

Grade 10 Grade 12 

Grade 11 Grades 7-9 



Elementary 



The CRISS Project will ; 

1- Provide two/three days, or the equivalent, of training. 

2. Train a local facilitator to provide immediat ■ and on-goinq assistance 
to classroom teachers trained to use CRISS. y 9 SSlstance 

3. Provide project-developed materials. to adopters. 

4 * and foll °w-up consultation for the staff 

of the adopting district by phone, written contract, or on-site Visi- 
tation as needed or requested by the adopting district Sees for fal 
low-up visits will be negotiated with the adopting district 

5. Provide guidance in evaluating CRISS' s effectiveness. 
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The Adopting District will : 



1. Provide release time for teachers and supervisors to attend the 
training session. An administrator from each participating school 
must attend this session. 

2. Provide a $40.00 per participant fee which covers costs of CRISS 
training manual, adopter's guide, workshop materials, and eval- 
uation materials or help. 

3. Identify a Local Facilitator to support adopting teachers and act 

as a liason to CRISS staff and the State Facilitator. Local Facili- 
tator duties will include periodic classroom coaching of CRISS 
teachers, convening regular support meetings for CRISS teachers, 
and maintaining regular communication with the CRISS staff. 

4. Implement the essential elements of CRISS as follows: 

a. Use the six components of the CRISS Project: Evaluating text, 
teaching text organization, understanding main ideas, developing 
learning strategies, teaching vocabulary, and implementing the 
Directed Reading Activity as part of content instruction. 

b. Follow the CRISS instructional model which includes four steps: 
Introduction, modeling, guided practice, and independent appli- 
cation . 

c. Use CRISS regularly as part of content instruction. 

5. Collect teacher and student impact data with evaluation materials 
provided by or developed with the help of the CRISS staff. 



The State Facilitator will : 

1. Assist in logistical and budgetary preparations. 

2. Assist in monitoring program implementation. 

3. Maintain contact with the adopting site and CRISS staff. 



CRISS Project Director Administrator, Adopting District 



State Facilitator 

Return to: CRISS Project 

School District No. 5 
233 1st Avenue East 
Kalispell, MT 59901 
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CONTENT READING IN SECONDARY SCHOOLS 
READING AND WRITING ACROSS THE CURRICULUM 



AGENDA 

Day 1; 



1. Theoretical Foundation for Learning Across the Curriculum 

a. background knowledge (pp. 2-3) curriculum 

b. active vs. passive learning (p. 3) 

c. direct instruction (pp. 4-6) 

d. mutacognition (p. 3) 

2. Text Assessment: Considerate and Inconsiderate Text 

a. overall structure of text (p. is, 

b. chapter structure (pp. 1S-13) 

c. paragraph structure (p. 13) 

d. vocabulary development (pp. U-15) 

e. contextual analysis (p. IS: clues p. 23) 

3. Student Assessment ( pp. 49-74) 
Teaching Text Organization 

a. teacher modeling and think-alouds (pp. 75-81) 

b. text assessment checklist for students (pp. 82-89) 
5. Main Ideas 

a. power thinking 

b. organization of main ideas (mystery pot) (p 93, 
c selection underlining (pp. 93-94) 

d. Notetaking from memory 

e. summarizing - paragraph summary < pp . 94-96) 
and one-sentence summary (pp. 97-93) 

f. peer editing 

g. conceptual mapping (p. 102) 

Day 2; 

5. Main Ideas, cont. 

n. Q.A.R. - question-answer relationships (pp. 99-101) 

6. Learning and Writing Stratgies 

a. generating students' background knowledge <pp 90-91, 

b. learning guides: two column and other forn:,?s'(p 103-20) 
c -free-response/thesis-proof or <P-103 20) 

hypothesis-proof (pp. 125-159) 
d- problem-solution and four paragraph papers (pp ip, IP41 

e. frame paragraphs and essay examinations pp ? 33 -f 3 5 

f. RAFT assignments in content area (pp. 146-^7 ' 
9. spool system paper - five nsrw^ I 

writina in m„Z I Paragraph paper format for 

writing in content areas (pp. 138-139) 

rr!"^ 1 ! 1 ? 9 "? lnq fWe P ara ^^b editing 
Chec l-list (p. 1^1) y 

''. Vocabulary Development 

a. sentence sysnthesi* ; pp . 162-16M 

b. sentence expansion (pp. 164-166) 



Directed Reading Activity < pp . 180-201) 
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CONTENT READING IN SECONDARY SCHOOLS 
READING AND WRITING ACROSS THE CURRICULUM 



3 DAY AGENDA 

D ay 1 ; 

1. Theoretical foundation for learning across the curriculum 

a. background knowledge 

b. active vs. passive learning 

c. research in teaching comprehension 

d . direct instruction 

e. metacognition 



2. Teachers as collaborative researchers and setting up class- 
room experiments 

3 . Text assessment : Considerate and inconsiderate texts 

a. overall structure of text 

b. chapter structure 

c. paragraph structure 

d. vocabulary development 

e. contextual analysis 

4. Teaching text organization 

a. teacher modeling and think-alouds 

b. text assessment checklists for students 



5. Student evaluation 

a. study skills inventory 

b. content informal inventory 

c. cloze assessment 



Main ideas 

a. organization of main ideas (mystery pot) 
b« selective underlining 

c. note taking from memory 

d. summarizing - paragraph summary & one-sentence summary 

e. peer editing 



Day 2 ; 

7 . Main ideas (cont. ) 

f. conceptual mapping 

g. Question-answer relatior hips (Q.A.R!s) 

8. Learning and writing strategies 

a. generating students 1 background knowledge before they read 

b. learning guides: Two column and various formats 

c. free-response/thesis-proof cr hypothesis-proof 

d. round robin vs. read-recall 

e. problem-solution and four paragraph papers 

f. framed paragraphs and essay examinations 



IB 



Day 3 ; 



9. Learning and writing strategies (cont.) 

g. R.A.F.T assignments in content area 

h. spool system paper - five paragraph paper format 
for writing in content area 

i. peer editing using five paragraph editing checklist 

10. Vocabulary development 

a. sentence synthesis 

b . sentence expansion 

c. vocabulary expansion 

d. contextual analysis 

11. Directed Reading Activity ( D.R.A.) 

a. brainstorming in groups to plan a DRA unit 

b. group presentations of DRA within content areas 

12. Spool paper summary 

13. Evaluation & teacher agreement 
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Samples from the training manual 
and student examples 




Content Reading in Secondary Schools 
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SAMPLES FROM THE TEXTBOOK ASSESSMENT CHAPTER 



Textbook assessment is critical to the effectiveness of a con- 
tent reading program. One of the main goals of the CRISS pro- 
ject is to help students become more responsible for their own 
learning. If reading materials are beyond the comprehension 
of most students, the task of creating learner independence will 
be more difficult. 

The CRISS project has developed Textbook Assessment Checklists 
for each of the four content areas: Language Arts, Science, 
Social Studies, and Mathematics. These checklists help a tea- 
cher or text adoption committee evaluate texts on the basis 
of content, organization within chapters and paragraphs, sen- 
tence structure, concept development, vocabulary density, and 
visual information. 

A portion of one checklist is illustrated below: 



TextbocX Assessment Checklist 



S'&r-e of text 

jthor 

Copyright 

Publisher 

I. Organization and Content 



Social Studies 



Class 



Grade 



A. Overall Structure of boofct 

1. Table of Content* Yes No 

2. Glossary Yes No 

3. Index Yes No 

4. Appendix Ye» No 



B. Overall Content: 



Yes Sonet imes No 



1. Does the overall content of the text 
reflect what you feel are essential 

concepts in your course? 3 2 1 

2. Examine the scope and sequence of the 

content. 3 2 1 

Is the content presented topically? 3 2 1 

b. Or, is the content presented 

chronologically? 3 2 1 



Or, is there a combined topical and 
chronological arrangement? 

Based on the above considerations, 
is the scope and sequence appropriate 
to the material covered in the text? 



Examine (if applicable) sections of your 

text which focus on more recent issues? 

Is the content up-to-date? 3 



-1- 19 



SAMPLES FROM THE MAIN IDEA CHAPTER - Conceptual Mapping 



One way to instill active comprehension and dynamic discussion 
is through group conceptual mapping. Students working, pre- 
ferably in small groups, decide upon the most important ideas 
in their reading assignments and how these idects relate to one 
another. Then they construct some type of visual scheme to 
represent their ideas t 

A student example is illustrated below: 



SAMPLES FROM THE LEARNING GUIDE CHAPTER - Two-Column Note taking 



Learning guides have been one oi the most successful components 
of the CRISS project. They are note taking procedures which 
are all designed to help students organize themselves for learning, 
Many formats from the general two-column form to material-spe- 
cific forms are presented in the training manual. The two- 
column format as shown below has the papef divided lengthwise 
into two columns* In the left-hand column is a question or 
key word describing an essential concept or main idea. In the 
right-hand column information elaborating on the concept or 
main point is written. The guide may be used for studying by 
covering the right column and trying to answer the questions 
given in the left column. 

A student sample is illustrated below: 



THE PEARL; CHAPTER ONE Study Culde 



Identify four characters 
introduced in the opening 
chapter of The Pearl. 



Kino, Juana , Coyot ito, the 
doctor. 



2. Whet provides the rhyme for the 

Song of the Family in Kino's mind? 
What causes Kino to hear the Song 
of Evil? 



The grinding stones worked by 
Juana create the rhythm for 
the Seng of the Family. The 
appearance of the tcorpicn 
ca-jses Kino to hear the Song 
of Evil. 



4. 
5. 



6. 



Think of a few words to describe 
the living conditions of the 
Indians • 

How does Kino injure his hand? 



How does the mood of the story 
change in the first chapter? 



Do you think Coyotito had ever 
seen a scorpion before? Explain. 
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3. Primitive, poverty-stricken, 
simple, uncivil ized, tradi- 
tional, isolated, etc. 

4. He smashes it against the gate 
of the doctor's house* 

5. In the beginning the mood is 
peaceful and calm. With the 
coming of dawn there are many 
pleasant sights, sounds, %nd 
smells. The characters seem 
content. When Coyotito is 
stung by the scorpion however, 
the mood of the story becomes 
threatening and fearful, as 
the Indians lose their 
feelings of security, a senss 
of evil replaces their sense 
of tranquility. 

6. No, Coyotito laughed when he 
saw the scorpion snd tried to 
r^ach out and touch it. He 
did not understand how 
dangerous it was. 
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SAMPLES OF WRITING STRATEGIES FROM MANUAL - Framed Paragraph 



It is the philosophy of the CRISS project that learning can be 
enhanced by writing. In the Learning Strategies chapter of 
the training manual many writing ideas are presented which 
help the student progress from a well written, structured 
paragraph to a five paragraph paper. Procedures for making 
writing assignments within the content areas are also presented. 

To use a framed paragraph the teacher must prepare a skeleton 
of a paragraph. Generally this includes a topic sentence and 
transitions where necessary to guide the students into giving 
support for a main idea and a conclusion. 

An elementary example frame and student sample are illustrated 
below: 



Weather in Montana is very different. First, ... Then, 
... Next, ... Finally, ... It is hard to believe ... 



Weather in Montana is very different . First , it doesn't 
even get cold until December. Then , there isn't any snow 
for Christmas. Next , it may be 4 0° one day and the next 
day it might be -20°. Finally , in March it is 60° until 
the last days when it snows. It is hard to believe wea- 
ther can change so much in one place. 
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SAMPLES FROM THE VOCABULARY CHAPTER - Sentence Expansion 



Each content area has its own vocabulary. If students are 
to learn independently in any area, they must learn its 
basic vocabulary. It is important in every subject area to 
provide some vocabulary instruction „ 

Sentence expansion is a procedure for helping students ex- 
pand and reinforce new vocabulary. A teacher writes a 
simple sentence on the board and then students brainstorm 
answers to the questions: what?, when?, where?, how?, 
and why7 Finally an expanded sentence (s) is written. 

A sample from a high school biology class is illustrated 
below: 



Original sentence: Plants photosynthesize 
Brainstormed ideas: What kind? 



When? 



Where? 

What is 
necessary? 

What is 
formed? 

Why? 



green , trees , flowering 
plants , grass 

daytime, summer, when sun 
is out, some parts don't 
require sun, in artificial 
light 

chloroplasts , leaves , 
chlorophyll 

sun light, water, carbon 
dioxide , temperature 

glucose, oxygen 



to change light energy to 
chemical energy 



Student example : 

Trees and flowering plants photosynthesize in the daytime. 
The chlorophyll in the chloroplasts located in the leaves 
combines with light, water and carbon dioxide to form glu- 
cose and oxygen. The end result is that light energy is 
changed into chemical energy. 
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EVIDENCE OP EFFECTIVENESS 



Evaluation Desig n 

The 



The primary evaluation of Proiect Crt<?<; ^ 
group designs. Study I utilized eiaht HtL? ? lnVOl Y ed tW ° P re 'POst comparison 
studies students in the SlSnSl ? J* 8 " 8 ° f hlgh SCh ° o1 < Junior.) .ociS 

teachers (two courses eaci £ . _ Zl L™™* ^ » 'our social 

studies 

teachers. X „ this way classes were rando^v A™ n J™ randdmlv assigned to 

Pair. Study II employed two development? ^ite intact J? ^T^ 1 condition in 
conies. The " — — «— ?J -^r\o Cl \^ 

treatment V1 g d r e o n :; ^r?^ 1 ^^^-^"- trough a pre/post 
AH project evaluations werl desired to larrtt A fr ° m ad °Ption site, 

classroom learning and testing situations? ' " Cl ° Sely M actual 



Instrumentation 



"levant^^o^ -lection of several pages of 

Prose w as then dissected into "La units" or u^! ^ ^ Sample ' The selec ^° 
"grid" and provide a consistent basis for LAi Underlyin * Proportions to form a 
conducted in the following way. Students Villi',* J SS f sment bv this method was 
after which, the text and an notes were rlJLlL At **" Pr ° Se f ° r 40 minute «' 
hours), participants were then asked II I re ?° Ved ' Aft « a period of delay (24 
as they could. Scoring waste t th n^cer of 52 iB *~tion the aJticU 

to recall. tne numoer of idea units an individual was able 



PRPTPCT 














POSTTEST 




STUDY 
(40 mins) 


DELAY 
(24 hrs) 


RECALL 
(40 mins) 


INTERVENTION 
(3 months) 


STUDY 
(40 mins) 


DELAY 
(24 hrs) 


RECALL 
(40 mins) 
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This strategy is considered to be highly sensitive to the effects of CRISS 
because students are given no external memory cues to aid recall and therefore must 
rely on the organizations and structures that they themselves have imposed on the 
prose material. In addition, the 24 hour delay between reading and recall makes the 
free recall format a sensitive measure of longer term or lasting retention. Research 
has shown that "forgetting" follows an exponential curve with the large majority of 
information being "lost" in the first 24 hours. 

Two different free recall formats were used in this evaluation. Studies I 
and III employed a 3 1/2 page single spaced social studies article about life in the 
1920 • s while Study II employed a science article of similar length on the 
physiological mechanisms of thirst. Although the content of these texts was relevant 
to the students 1 course of study, care was taken to avoid the inclusion of material 
that might be encountered by the students during the treatment period. In this way, 
the presented results solely reflect changes in recall ability and are not 
contaminated by such variables as study time. These free recall instruments 
obviously possess high content and face validity. Interrater reliability 
coefficients calculated on two independent scorers across 30 tests for the described 
instruments ranged from .91 to .94. 

In RECOGNITION, the student is able to select the appropriate fact from a 
list of facts. In this way, he "recognises" what he has previously learned. Relying 
on the recognition indices of memory, this dimension of content retention is a much 
lower level skill than recall because such memory cues as multiple-choice distractors 
are necessary to aid the recall of information. 

Project effects on the recognition dimension were assessed in two ways. In 
Study I, subjects were measured on the American History subscale of the Comprehensive 
Assessment Program (CAP) • This standardized content test was selected on the basis 
of its content validity. The publishers estimate the reliability (KR-2J) of the 
subscale at 0.87. This instrument is widely used to assess social studies programs, 
usually on a post-only basis. A second instrument was used to assess recognition in 
Study II. Here, a multiple-choice format test was constructed around the "Thirst" 
reading selection described above. Test items were developed by two science teachers 
and examined for content validity by five other professionals. The test was then 
revised until all teachers agreed that its 25 items addressed the key points of the 
article. Test retest reliability was estimated at 0.83 0 Like the Recall format, 
this test was also administered with a 24-hour delay. 



Data Collection and Scoring 

All data were collected by the classroom teachers. However, several 

precautions were taken in order to ensure reliability. Identical test directions for 

all assessments were read by the teachers to each group, the time allocations for the 

reading and recall/testing portions of the tests were standardized, and in order to 

eliminate the possibility of scorer bias, all tests were scored blind (unaware of 
experimental condition) by a well trained and practiced scorer. 
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Evidence of Project Impact 



Study I was designed to assess the impact of Project CRISS on two distinct groups of 
students. The study employed eight junior level social studies classes from Flathead 
High School in the Kalispell Public Schools. Four of these classes were "college 
bound" and four were vocational or "non-college bound*. The eight classes were 
taught by four teachers (two classes each). Teachers, rather than classes were 
randomly assigned to treatment and comparison conditions. in this way, classes were 
randomly assigned to experimental condition in pairs. Treatment teachers received 
the CRISS training prior to the beginning of the study. No CRISS training was given 
to comparison teachers. 

Both the Free Recall Test I and the CAP (American History subscale) were 
administered according to the described procedures during the first week of September 
1983. Students were post-tested on recall during the first week of December of the 
3ame year, while CAP post-testing was conducted in May 1984. Direct CRISS instruction 
was given only in the first semester. During this time, comparison students received 
their regular social science instruction while treatment students received the same 
tutorage plus CRISS instruction. All CRISS activities took place within the time 
allocated for social science and consumed an average of 5 minute per class. 



Results 

*• College Bo und Students . Pre and Post test means, standard deviations and mean 
gains for treatment and comparison groups (free recall data) are presented in Table 1 



Table 1: Pre and Post Means, Standard 
Deviations and Mean Gains for College- 
Bound Students (Free Recall Data) 







PRE 


POST 




Group 


n 


X 6 


x s 


x gain 


Treat . 


47 


10.43 4.74 


22.85 8.79 


+ 12*42 


Comp. 


50 


13.28 5.44 


19.56 5.20 


+ 6.28 



25 



20 



15 



10 - 



Figure 1 
Free Recall/ College 




PRE 



POST 



While significant differences (t»2. 59;p< . 05) in favor of the comparison group 
existed at pre-test, CRISS students significantly outperformed their comparison 
counterparts following the treatment period (t-2.03ip< .05) . In a two way ANOVA with 
repeated measures, this classic interaction effect (groups X tests) was significant 
at the .001 level (F-23.04). This effect is oraphically presented in Figure 1. 
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During the course of the treatment period, CRISS students improved their free recall 
test performance by approximately two standard deviations. As in any two-trial 
learning situation (testing -Tfect) of this kind, gains were also expected of and 
made by comparison students. These gains were, however, approximately half of, and a 
full standard deviation less than, those made by CRISS students. 

Pre and post CAP data for the same study are presented in Table 2. While 
no significant differences between the two groups existed prior to the treatment 
period (t»0.73), the treatment group significantly outperformed its comparison 
counterpart following the CRISS intervention* This effect was consistent across 
classrooms. No differences by sex were observed (t*0.56). In more interpretable 
terms using publisher's norms, while the two groups were highly similar prior to the 
intervention, the 91st median percentile post-test ranking recorded by CRISS students 
far exceeded that of the re?ular curriculum group (67th percentile). 



Table 2: Pre and Post Means, Standard 
Deviations and Mean Gains for College- 
Bound Students (CAP Data) 





PRE 


POST 




Group n 


X 8 


X 8 


x gain 


Treat. 44 
Comp. 42 


20.50 4.32 
19.73 5.39 


36.81 5.55 
28.45 6.46 


+ 16.31 
+ 8.73 



40- 
35 - 



x 30 <- 



25 f 
20 



Figure 2 
CAP/College 



PRE 



POST 



B. Non-college Bound Students . Pre and post free recall data for non- allege 
students are presented in Table 3. An interpretation of this information leads one 
to conlude that non-college CRISS students significantly outgained their equivalent 
comparison group during the treatment period. While no differences between the two 
groups were evident at pre-test (t^l.T.Sjp^ns), large differences in favor of the 
project students were observed following CRISS treatment (t M 7.27|p<.001). Gains made 
by the comparison group (x gain«3.33) were approximately one third of those recorded 
by CRISS students (x gain*10.91) who improved their pre-test performance by over two 
standard deviations. This differential performance by the two groups is graphically 
represented in Figure 3. 



Table 3; Pre and Post Means, Standard 

Deviations and Mean Gains for 
Non-college Students (Free Recall Data) 





PRE 


POST 




Group 


n 


X* 8 


S 8 


x gain 


Treat. 


44 


7.32 3.92 


18.23 6.36 


+ 10.91 


Comp. 


42 


6.10 4.48 


9.43 3.97 


+ 3.33 



Figure 3 
Free Recall/Non College 
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When CAP data for the same groups were examined (Table 4), it was found that 
while the comparison group performed significantly better (t« -2.74 >P <.01) than the 
CRISS group prior to treatment, the effect was reversed following the intervention 
(t«4.01>p<.001). CRISS students outgained their comparison counterparts by over one 
standard deviation and post-tested at the 71st median percentile as compared to the 
46th percentile performance of the non-treatment group. Once again, the reliability 
of the effect was evident in the absence of class differences. Sex was not a factor. 



Table 4: Pre and Post Means, Standard 
Deviations and Mean Gains for 
Non-college Students (Multiple Choice Data) 







PRE 


POST 




Group 


n 


X 


s 


x s 


x gain 


Treat. 


40 


14.57 


4.51 


28.55 6.23 


+ 13.98 


Comp. 


38 


17.47 


4.75 


22.87 6.26 


+ 5.40 



30 
25 
X 20i 
15 
10 H 



Figure 4 
CAP/ Non College 
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Study II, conducted in Kalispell Public Schools provides evidence of the 
project's effectiveness in the area of science. Conducted in the fall of 1983, this 
study employed two non-college bound sophomore science classes taught by two science 
teachers and spanned a full semester. One of the cooperating teachers received CR^SS 
!!th n M? P" or to the beginning of the study and began implementing the curriculum 
with his students immediately following the pre-test administration of the recall and 
'pf^?i I 0 "- te tt S ' * CTISS intervention precisely followed the procedures previously 

« SS and no «5m 7^1' ^ C °^" SOn clas " oom teacher was not trained in 
CRISS and no CRISS instruction was given to the comparison group. The results of 
this study are presented in Table 5. 

An examination of free recall data reveals that while no significant 
s tllenlTlJ t :: 19 'fT nS) the two grou^ existed prior to treatmen?" c£ss 

6 S "?; iflC " tly their equivalent comparison group at post test 

It J.47,p<.01). When these data are examined in a Two-Way ANOVA with reoeated 
measures . significant interaction effect (P-11.04,p<.002) i* found (Figure T 
similar interaction (groups X tests) is noted when multiple choice data 2re processed 
in the same manner (F«7.823|p<.008). processea 



9 

ERJC 



28 

-5- 



Table 5: Pre and Post Means, Standard Deviations and Mean 
Gains for Treatment and Comparison Non-college Bound 
Science Classes (Free Recall and Multiple Choice Data). 





PRE 


POST 




Test 


Group 


n 


X 


8 


X s 


x ga i n 




Treat. 


19 


6.11 


2.31 


16.16 6.81 


+ 10.05 


Free Recall 
















Comp. 


19 


5.98 


1.78 


10.42 3.78 


+ 4.47 




Treat. 


19 


12.05 


3.96 


15.47 4.85 


+ 3.42 


Mul. Choice 
















Comp. 


19 


13.26 


2.98 


13.21 3.68 


- 0.04 



Figure 5 Figure 6 

Free Recall Data Multiple Choice Da+*a 
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In summary, the data presented provide strong testimony to the impact of 
Project CRI5S on both college and non-college populations. In both recall and recog- 
nition test formats, significant effects (p<.005) in favor of treatment students were 
noted. The data were both consistent and descriptive of trends one might intuitively 
expect, thus lending credibility to the evidence presented. It is also important to 
note that CRISS social studies teachers reported better classroom performance on the 
part of their students than did comparison teachers. In addition, semester grades In 
history were considerably higher in the treatment classes with 30% more "A" and "B H 
grades. The described improvement in student learning can be directly attributed to 
a change in instruction. Teachers implementing CRISS strategies teach students how to 
learn from their reading along with content instruction. As a consequence, students 
are able to directly apply learning stategies to their regular course assignments and 
learn more course information. 



Evidence of the Generalizability of the Effect 

Study III was conducted at a CRISS adoption site similar in nature to the Kalispell 
School District and employed two classes of college bound senior social studies 
students. The two teachers of these classes received standard CRISS training one 
w?3k prior to the beginning of the investigation. Prs-tests were administered in 
March and post tests two months later in May of 1983* Experimental and treatment 



procedures were identical to those previously described, 
study are presented in Table 6. 



The data gained from this 



Table 6: Pre and Post Means, Standard Deviations and Mean 
Gains for Two Adoption Site Social Studies Classes (Free 
Recall Data) 1 







PRE 


POST 




Group 


n 


X 


8 


x s 


x gain 


Class 1 


27 


22.00 


9.57 


41.70 13.85 


19.70 


Class 2 


25 


18.68 


9.96 


40.04 17.15 


21.36 


TOTAL 


52 


20.40 


9.81 


40.90 15.33 


20.50 



As can be seen, both classes of adoption site students exhibited oain<? of 
approximately two standard deviations fro, the pre-test mean scores^ This growth is 
of the same order as that attributed to developmental site students. 

In summary, these data provide evidence of the genera lizability of the effect 

TtlTZt ^ ^ devel °f™ ntal site ' ^e gains of two classes of adoption site 
students were of a similar magnitude to those reported in Study I. 

Educational Significance 

Project CRISS deals with the subject matter of the greatest importance 
Learning how to learn from reading is a fundamental skill vita! to the success of 
students in all areas of endeavor. success of 

The magnitude of the change caused by this program is clearly evident 
Project student gains consistently exceeded two full standard deviations when 
assessed by recall tests. Even with the less sensitive recognition format, stude" 

of in tes?? n r r ma H ed r f and ? rd dGViation ' In " al terms. af?er removing the effects 
of testing and maturation (estimated by comparison group data) college bound CRISS 
students increased by 60% and non-college students doubled the information S»y lire 
able to retain. This effect is substantial, to say the least. This lelel of in- 
studel r tenti ° n : eXtra *° lated a "°" the subject matter encountered by a 

Smenaf^ctr — f ^ ~ *er high school tutorage, would result" in 



Repl icabi 1 ity/General i zabi lity 

The evidence presented and the experience of CRISS staff indicate that the 
program is readily implemented in other school districts The „ ' • 

CH^staf'f reCU " ing . C ° St - N ° ^ facint^sTteac^nn^ Ire'™* 

sr.: SLrzszzz? isiHoS iiiioT n = s rr tations at Sl 

ra a ^ a s n the eite ' Pr ? j r criss has trSis 1 :™ t^c^rslror^^^h-ordi^trfcls: 

In addition the project has received widespread attention through its presentations 
at national and regional conferences and through staff authored publications in book 
chapters and professional journals. CRISS staff have hosted m£ny visitors at ^e 
pro 3 ect site and have authored the necessary materials for dissemination 
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Project 



School District No. 5 2.33 First Avenue Ease Jialisjdl, Montana 53301 



The following article appeared in the September, 198G issue of 
the Maine Facilitator Center Newsletter. 




High School Study 
Skills 

Every once in a while, we offer a new program to 
Maine school districts that takes us by surprise. Last 
>ear, when we introduced Content Reading in 
Secondary Scliools (CRfSS) to Maine high school 
teachers, we didn't expect such unabashed enthusiasm 
for this high school study skills program. Maine 
teachers unanimously praised the program as being 
immediately useful and relevant to any content area 
subject. 

What seems particularly appealing is CRISS's 
approach to study skills. Rather than add on to an 
already overfull curriculum, CRISS advocates 
changes in instructional style, not a change in 
materials. The program offers new strategies for 
reaching specific subject matter. And what makes 
CRfSS particularly appealing to veteran teachers, is 
that it offers a variety of techniques from which to 
choose. There's no rigidity or -ucture that dictates a 
specific sequence or strategy. er, the teacher chooses from an array of ideas - modifying, adapting, adding or 
eliminating steps that don't seen, suitable for a particular teaching style or group of students. 

Validated f or grades 10-12, CRISS offers creative reading, writing, organizational, and studying strategies 
for students in grades 4-12, in any content area. Two CRISS training workshops have been scheduled in Maine 
this fall, one each in Scarhoro and Augusta. 

Call our office for additional information about CRISS or the forthcoming training workshops. 



CKJSS trainer Lynn Oiavens (Q confers tuith Jan grant, 
a Scarborough Ofigh School teacher who untf Become an 
instate trainer for this popular program. 



For additional information about the CRISS Project write to 

the above address or call Lynn Havens or Carol Santa, (406) 755-5015. 
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The following comments are from Bradford County School District 
teachers in Starke, Florida. Their training was in August, 1986 



My response to our tvo-dav workshop and additional 
comments are: C\\v\<ea c\ )p4 d*( 



J\* uimJB^laaQ ^ «a«aJ77^, 



s £ ■ » 
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